μ Max-Unity3D Interoperability Toolkit

Object-oriented rapid prototyping tools geared towards multimedia, such as Max/MSP/Jitter and Pd/Gem, serve as a powerful foundation for efficient multimodal crosspollination and integration. Although both Max and Pd support OpenGL, the lack of scalability, user-friendly 3D editor, and physics engine makes them less desirable solutions for the rapid development of complex environments and physics simulations. Unity3D is a powerful rapid 3D video game prototyping platform with an integrated physics engine. Its audio capabilities, however, are limited mainly to triggering and spatialization of audio buffers. μ is a toolkit offering easy integration of Max/PD with Unity3D, allowing for exchange of control data, as well as importing of dynamic Jitter textures into Unity3D. The former makes it particularly suitable for efficient sonification of physics simulations. μ has been utilized in Elemental, an interactive communal soundscape installation (part of the Revo:oveR exhibit) allowing for visitors’ motion (Max) to drive a physics engine (Unity3D) and sonify ensuing data across a 12-channel ceilingmounted speaker array (Max).